LAVa: Layer-wise KV Cache Eviction with Dynamic Budget Allocation
arxiv.org·13h
📋JSON Parsing
Semantic Dictionary Encoding
falvotech.com·2h·
Discuss: Hacker News
🗂️Type Indexing
LLMs on a Shoestring: The Dynamic Cache Advantage by Arvind Sundararajan
dev.to·7h·
Discuss: DEV
💾Cache Algorithms
Language Models Pack Billions of Concepts into 12,000 Dimensions
nickyoder.com·13h·
🌱Minimal ML
Analog IMC Attention Mechanism For Fast And Energy-Efficient LLMs (FZJ, RWTH Aachen)
semiengineering.com·49m
Tokenizer Optimization
Conquering the LLM Memory Wall: How to Run 2–4x Longer Contexts with a Single Line of Code
reddit.com·5h·
Discuss: r/LocalLLaMA
🌪️V8 Pipeline
Show HN: Semlib – Semantic Data Processing
github.com·3h·
Discuss: Hacker News
🔍ML Language
Symmetric MultiProcessing, Hyper-Threading and scheduling on Maestro
blog.lenot.re·9h
Instruction Fusion
More hardware won’t fix bad engineering
infoworld.com·8h
🔮Branch Predictors
Spatial Transcriptomics Data Fusion via Multi-Modal Signal Disambiguation and Graph-Enhanced Integration
dev.to·1d·
Discuss: DEV
🔢Algebraic Datatypes
Why some agentic AI developers are moving code from Python to Rust
developers.redhat.com·10h
Interpreter Optimization
[NodeBook] Understanding Buffers in Node.js - Why they exist, where they live in memory, and how they handle binary data
thenodebook.com·9h·
Discuss: r/node
🔢Binary Formats
How to Become a Machine Learning Engineer (Step-by-Step)
towardsdatascience.com·5h
🌱Minimal ML
Crashes are loud. Leaks are quiet.
blog.bitdrift.io·17h
🧠Memory Ordering
Introducing Segment Anything: Working toward the first foundation model for image segmentation
ai.facebook.com·6m
🧠Semantic Parsing
🥬 Freshness Checker AI: The AI-Powered Food Safety Assistant
freshness-checker-ai-460322848371.us-west1.run.app·12h·
Discuss: DEV
🌊Gradual Effects
Rowhammer: TRR on DDR5 DRAM has been broken
comsec.ethz.ch·29m·
Discuss: Hacker News
🏷️Memory Tagging
Optimized Modbus RTU Data Validation via Hybrid Markov & Bayesian Filtering
dev.to·7h·
Discuss: DEV
🔄Protocol State Machines
Topological Sort: Managing Mutable Structures in Haskell
mmhaskell.com·8h
🪢Rope Data Structures